Conndence Measures for Image Motion Estimation 2. Introduction

نویسنده

  • Frans C. A. Groen
چکیده

1. Abstract Estimation of image motion, also known as the optic ow, from a sequence of images is known to be diicult. This is due to: the sensitivity of the image motion model to noise (the derivative property), the limited observability of the image motion from the luminance (the aperture problem), and, the non-validity of the optic ow constraint (the assumption of intensity conservation). In this paper we analyze measures that assign a conndence value to the estimated image motion: the sensitivity of the model to noise, the validity of the model and the estimated variance of the image motion. Experiments show that selection of image motion vectors based on these measures dramatically improve the estimates of the image motion while keeping as much image motion vectors as possible. We conclude that the proposed estimated variance of the image motion optimizes this trade-oo. The estimation of image motion ^ v(x;t) from a sequence of images I (x; t) is a well addressed 8] problem in computer vision. The assumption of conservation of image intensity results in the well known optic ow constraint 2]: rI(x; t) v(x;t) + I t (x; t) = 0 (1) Since the optic ow constraint (1) gives only one equation to the image motion vector at every point, an additional equation is needed to estimate the two components of the image motion vector. The method reported in 1] 7] uses a parametric model of the image motion to produce the image motion from the the optic ow constraint. The underlying assumption of the model is that the image motion is constant in a very small region S. Every op-tic ow constraint in region S eliminates one free parameter of the image motion vector. Since the vector has 2 free parameters, theoretically 2 such constraints are enough if the spatial derivatives are non coplanar. However, since the image (time) derivatives may be noisy, a Least Mean Square solution will generally be more robust. This can formally be translated in to minimizing the func

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Motion estimation using complex wavelets

This paper describes a new wavelet-based approach to the motion estimation problem for digital video. A complex-valued Discrete Wavelet Transform is used to decompose each frame into a subsampled directionally bandpass ltered hierarchy. The transform is deened so that at each level there is an approximate correspondence between local translation and coeecient phase shift. This relationship is u...

متن کامل

Improved speech recognition using iterative decoding based on confidence measures

In this paper, a decoding method incorporating word-level conndence measures for improved speech recognition is presented. At rst, we focus on the estimation of conndence measures from the word graph and evaluate them in word graph rescoring (2nd-pass in 2-pass search system). Next, we propose the lexical tree search (1st-pass in 2-pass search system) incorporating the word-level conndence meas...

متن کامل

Wavelets in Image Analysis: Motion and Displacement Estimation

This paper describes a generalisation of the conventional discrete wavelet transform (DWT) to use lters with complex coeecients. This provides the important advantage that the transform becomes approximately shift-invariant and becomes well suited to estimating motion in digital video signals. We present a hierarchical region-based matching algorithm, which operates on the coeecients of a separ...

متن کامل

On models, criteria and search strategies for motion estimation in image sequences

Motion estimation is one of the key techniques helping solve problems encountered in image sequence compression and processing, and in computer vision. Redundancy elimination in digital video and tracking of moving objects in surveillance applications are but two interesting tasks where the knowledge of image motion is essential. Due to a strong correlation of image properties in the direction ...

متن کامل

Pseudo Zernike Moment-based Multi-frame Super Resolution

The goal of multi-frame Super Resolution (SR) is to fuse multiple Low Resolution (LR) images to produce one High Resolution (HR) image. The major challenge of classic SR approaches is accurate motion estimation between the frames. To handle this challenge, fuzzy motion estimation method has been proposed that replaces value of each pixel using the weighted averaging all its neighboring pixels i...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997